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Abstract. We prove some new a priori estimates for /^-convex functions which are zero on 
the boundary of a bounded smooth domain Q in a Carnot group G. Such estimates are global 
and are geometric in nature as they involve the horizontal mean curvature Ti of d^l. As a 
consequence of our bounds we show that if G has step two, then for any smooth _ff2-convex 
function in fl C G vanishing on dfl one has 

V / ([X i ,X j ]v) a dg < \ f U \V H u\ % da H ■ 
i,j=i-' n 6 Jan 

1. Introduction and statement of the results 

In this paper we study some a priori estimates of geometric type for functions vanishing on 
the boundary of a smooth bounded open set in a Carnot group. The estimates that we obtain 
are of interest in connection with the study of the geometric notion of convexity in Carnot 
groups recently introduced in [DGNlj . see also [LMS) . [GMT] . [GT] . [DCNTj . [Wal] . [Wa2] . 
[Maj . They also play a central role in establishing a priori bounds in L 2 for the (horizontal) 
second derivatives of solutions of non-variational operators with rough coefficients. In this 
respect, a global version of our results (with sharp constant) for compactly supported functions 
in the Heisenberg group M n has been recently established in the very interesting recent work 
of Domokos and Manfredi, see Lemma 1.1 in [DM], using the deeper spectral decomposition of 
Strichartz [Str] . An alternative proof of the estimates in [DM] , which however does not produce 
the best constant, would be to use the subelliptic estimates, see [Ko] and [H]. 

Our results are intimately connected to those in [DGNT| . except that the approach in that 
paper was based on monotonicity formulas for a certain fully nonlinear subelliptic operator, 
rather than geometric inequalities as those in the present paper. One interesting and novel 
aspect here is that the relevant estimates depend in an explicit way on a new geometric object, 
the so called horizontal mean curvature of the boundary of the ground domain. Whether our 
method is capable of producing estimates with sharp constants or not presently remains an open 
question. Our approach is based on some delicate (but otherwise fairly elementary) integration 
by parts formulas which are combined with a sub-Riemannian Bochner type identity. The latter 
is inspired by the classical one from Riemannian geometry which states that for a Riemannian 
manifold M with Levi-Civita connection V, one has for u € C 3 (M) 

(1.1) A(|Vu| 2 ) = 2 ||V 2 u|| 2 + 2 <V-u,V(Au)> +2ffic(Vu,Vu) , 

where Ric(-, •) represents the Ricci tensor. A beautiful generalization to CR manifolds of (11. ip 
was found by Greenleaf in [Grej . Another tool that we use in the proof of Theorem 11.81 b elow is 
a sub-Riemannian Rellich identity discovered in |GV] . 

In the classical case a basic a priori estimate of the elliptic theory reads 

(I- 2 ) IMlH/2,2(C2) < C (||L«|| L 2(n) + ||«||l,2(Q)) , 
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where £1 C M n , and L is a second order uniformly elliptic operator. One of the main tools in the 
obtainment of (11.21) is the following geometric a priori inequality 



(1.3) f \\V 2 u\\ 2 dx < C ( [ (An) 2 dx + [ u 2 dx) , 

Jn \Jn Jn J 

valid for any u G C 2 (f2), with u = on dQ, where £1 C M. n is a bounded open set which 
is piecewise C 1 and whose principal curvatures are bounded, see [LUj . Lemma 8.1 on p. 175. 
Here V 2 w denotes the Hessian matrix of u, and ||V 2 u|| indicates its Hilbert-Schmidt norm. 
The constant C > depends on various parameters, among which appropriate bounds on the 
principal curvatures of d£l. The prototype of estimates such as (|1.2p and (jl.3p first appeared 
in two dimension in the pioneering works of S. N. Bernstein [Bel| . [Be2j. Several years later 
Kadlec |Kaj first obtained a higher dimensional version of fjl .3f) for convex domains. One should 
also see the works of Ladyzenskaya and Uraltseva [LU] , Talenti |Taj , Grisvard [Grj , Lewis |Lej . 

We consider a Carnot group G with Lie algebra q (for the relevant definitions and properties 
see Section [2]). We assume throughout that G is endowed with a left-invariant Riemannian 
metric with respect to which the Lie algebra generating left-invariant vector fields X\, ...,X m 
defined in (|2.5p below constitute an orthonormal basis of the horizontal subbundle HG. If £1 C G 
is an open set and k G N, we denote by r fc (f2) the Folland-Stein class of functions u G C{G) 
such that for every 1 < s < k one has Xj 1 ...Xj s u £ C(G), where jn G {1, ...,m} for 1 < t < s. 
Given a function u € T 2 {G) we let S/ H u = Y^ILiXiuXi denote the horizontal gradient of u. 
If C = YliLi QXi G T 1 (G, i?G), then we let divnC = YliLi-^-id- The horizontal Laplacian of 
u G r 2 (G) is then given by 



A H u = div H = y^X. 



fu . 



i=l 



The symmetrized Hessian of u is the m x m matrix defined by 



XiXjU + XjXiii 

jja — L'UjijJ j wuei'tj u jj = 



Virtt = \u a] , where u — - — — - 



and clearly A^ti = trace V 2 H u. The matrix V^u plays a central role in the study of convexity 
in Carnot groups. It was in fact proved in |DGNlj . [LMS] that a function u G T 2 is H -convex 
(see definition (|1.17|) below) if and only if V^n > 0. 

Our first result is an integral identity which connects an interesting fully nonlinear subelliptic 
operator to the geometry of the ground domain through the ff-mean curvature TL of its boundary 
(for the latter notion, see Definition 12.21 below). In what follows we denote by dan the H- 
perimeter measure on d£l, see Definition 12.51 and also [DGN2]. 

Theorem 1.1. Let G be a Carnot group and consider a C 2 bounded open set O C G. Let 
u G r 3 (S7) n C 2 (Q) with u < in $7 and u = on dQ. One has 

(1.4) ^|(A^) 2 -||V|,n|| 2 |^ + J E J^Xjju) 2 dg 

+ V / XiU^X^X^X^udg = / H\V H u\ 2 da H . 
„■ „•_■, Jn J on 
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When the step of G is two, then the third integral in the left-hand side of (jl.4p vanishes. If 
instead u E Cq°(£1), then one obtains 



(1.5) 



|V^|| 2 



dg = (A H u) 2 dg + - ^ (PQ,X» 2 d 5 

i,j=l 

m „ 



It is interesting to state explicitly Theorem II .11 in the special, yet important situation, when 
= BP, the Heisenberg group, with group law 

g og' = (x, y, t) o (V, y', t') = (x + x', y + y', t + 1' + -(x ■ y' - x' ■ y)) , 



and the left-invariant basis for the Lie algebra 
d yj d 



(1.6) 



A n 



d xj d 

dy~ + ^di' • ? = 1 '-' n ' 



_ ^ 

;)... -)(' - A... + o J - l,-,n, r - ^ . 

We note that the vector fields X±, ...,X2 n satisfy the commutation relations 

[Xj,X n+k ] = 5 jk T , j,k = 1, ...,n , 
and therefore they generate the Lie algebra of BP . 

Corollary 1.2. Consider a C 2 bounded open set SI C BP. Lei u G T 3 (S7) n C 2 (f2) u>ii/i -u < in 
SI and u = on d£l. One has 

(1.7) / (A H u) 2 dg - f \\V 2 H u\\ 2 dg+ \n f (Tu) 2 dg 

Jn Jn z Jn 



H \Vhu\ dan 



mi 



As a consequence, if dQ has H-mean curvature H>0, then 



u) 2 dg . 



(1.8) f \\V 2 H u\\ 2 dg < [ (A H u) 2 dg + In f(T 
Jn Jn ^ Jn 

If instead u G C^(Q), then regardless of the sign ofH one obtains 

(1.9) ( \\V 2 H u\\ 2 dg = ( (A H u) 2 dg + I (Tu) 2 dg . 
Jn Jn 1 Jn 

When n = 1, then lll.7|) becomes 

(1.10) [ det(V 2 H u) dg + - A [ (Tu) 2 = \ \ H |V ' H u\ 2 da H ■ 
Jn 4 Jn 1 Jan 

With some appropriate modifications, Theorems 11.11 and Corollary 11.21 are still valid if one 
removes the assumption that u < in f2. The following result easily follows by keeping track of 
the various terms appearing in the proof of Theorem II .11 

Theorem 1.3. Let G be a Carnot group of step r = 2, and consider a C 2 bounded open set 
HcG. Let u G T 3 (Q) n C 2 (Q) with u = on dQ. One has 



(1.11) 



/ (A H u) 2 dg - f \\V 2 H u\\ 2 dg + - jh f ([X,X» 2 dg 
Jn Jn 4 -~, Jn 



< 



\H\ \Vhu\ dan ■ 



dn 
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We next obtain some basic consequences of Theorem 11.11 when the function u is H^- convex. 
With this hypothesis we are able to bound the L 2 norm of the commutators [X{, Xj]u in terms 
of a weighted integral of the ff-mean curvature of d£l. 

To introduce the relevant notions we recall that for r = 1, m, the r-th elementary symmetric 
function is defined by 

(1.12) S r {x) = } y Xj x ... x ir , 1 < r < m . 

n <...<«,- 

When r > 1 we can use such functions to form the fully nonlinear differential operators 

(1.13) T r [u] = SV(Ai («),..., X m (u)) , 

where Xi(u), X m (u) denote the eigenvalues of the symmetrized Hessian of u. One easily 
recognizes that 

m 

(1.14) T\[u\ = S\{X) = trace{V 2 H u) = Ajju = (horizontal Laplacian) , 

i=l 

(1.15) F 2 [u] = S 2 {\) = £ " "-.l, - u %) = \ {( A hu) 2 -HV^nH 2 } , 

i<3 



(1.16) Fmlu] = S m (X) = det Vjy(it) (horizontal Monge- Ampere) . 

Definition 1.4. For r = 1, ...,m, a function u G T 2 (G) is called H r -convex, if J-k(u) > for 
k = 1, r. 

For these notions and for related results we refer the reader to the paper [DGNTJ. 

Remark 1.5. We observe that Hi- convex functions correspond to subharmonic functions, i.e., 
Ahu > 0, whereas a function u is H2-convex if A H u > and (A H u) 2 - \\V 2 H u\\ 2 > 0. We recall 
the following geometric notion of convexity introduced in [DGNlj . One should also see [LMSJ 
where a notion of convexity in the viscosity sense was set forth. These two notions have been 
recently shown to be equivalent, see [Walj . [Wa2j . [RiJ. A function u : G — > R is called H -convex 
if given any point g € G and < A < 1, the following inequality holds 

(1.17) u{g5 x {g- l g')) < (1 - X)u(g) + Xu(g') , for every g' G H g , 

where H g indicates the horizontal plane through g G G. In f|l. lTj) we have denoted by 5\ : G — > G 
the anisotropic dilations on G. The point g5\{g^ 1 g') denotes the twisted convex combination of 
g and g' based at g. According to Theorem 5.12 in [DGNlj, a function u is H m -convex according 
to Definition \1.4\ if and only if u is H -convex. 

Theorem 1.6. Let G be a Carnot group of step r = 2, and consider a C 2 bounded open set 
DcG. Let u G T 3 (f2) n C 2 (Q) be H2-convex in Q with u = on dQ. One has 

V f (PQ,X» 2 dg < \ [ H \V H u\ 2 da H . 
~~Z X Jn 6 J an 

In particular, if G = W 1 , one obtains 

(1.18) f (Tu) 2 < ^- [ H \V H u\ 2 da H ■ 

Jn 3n J dn 
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We note that, according to Lemma 12.41 under the hypothesis of Theorem 11.61 we must have 
TL > on 80, \ E, where E denotes the characteristic set of 9Q, see definition (|2.7p below. Since 
thanks to results of Balogh |Baj and Magnani [Ma| we know that ctj^(E) = 0, we conclude that 
H > (jjy-a.e. on 

One should compare the sharp geometric bounds in Theorem 11.61 with the following non- 
geometric local a priori bound established in [DGNTj . see also [GMlJ, |GT] and [GM2] . 

Theorem 1.7. Consider a bounded open set in a group of step two G. Let u € T 3 (S7) be a 
H2- convex function. For any D CC D' CC f2 we have for some constant C > depending on 
G,n, D', and D 




The next theorem provides a basic global a priori bound for the L? norms of the commutators 
of an i?2-convex function vanishing on the boundary under the assumption that the ground 
domain be starlike (in a weak sense) and that the horizontal mean curvature of its boundary 
be bounded. In the starlikeness assumption in (|l,20p below, the vector field Z indicates the 
infinitesimal generator of the non-isotropic group dilations. For its definition see (|4.9p below. 

Theorem 1.8. Let G be a Carnot group of step r = 2, and let f2 C G be a C 2 bounded open set 
such that for some M, a > 0, 

(1.19) sup \H\ < M , 

an 

and, with W as in (|2.6[) below, suppose that 

(1.20) inf < Z,v > > aW . 

There exists a constant C(G, O, M, a) > such that for u £ r 3 (J7) n C 2 (Q) which is H2-convex 
in Q, and satisfies u = on dfl, one has 



(1.21) 




The proof of Theorem 11.81 is accomplished by combining Theorem 11.61 with a sub-Riemannian 
Rellich identity discovered in |GVj , see Theorem 14.21 and Corollaries 14.31 and 14.41 These results 
allow to establish Lemma [4 . 5 1 which is instrumental in controlling the commutator term in (|1.21[) 
in Theorem 11.81 solely in terms of the L? norm of the horizontal Laplacian. We notice explicitly 
that, since by (12. 7ft at the characteristic points of <9f2 the angle function W vanishes, condition 
(|1.20p is a weak starlikeness assumption with respect to the non-isotropic group dilations (|2.ip 
below. We also emphasize that in a Carnot group of arbitrary step a basic family of domains 
satisfying the hypothesis (|1.19p and (jl.20p in Theorem 11.81 is represented by the gauge pseudo- 
balls centered at the group identity, see Proposition 14.61 

We mention at this point that after this paper was submitted we learnt from J. Manfredi of 
his interesting preprint [CM| joint with Chanillo in which, using the above mentioned Bochner 
identity due to Greenleaf |Grej . the authors obtain a priori estimates connected to those in 
Theorem II. 1\ but for strictly pseudo-convex CR hypersurfaces M 2n+1 C C n+1 . There are 
however two essential differences between our work and |CM| . and neither of these papers is 
contained in the other. On the one hand there is the obvious fact that there exists in nature 
a plentiful supply of Carnot groups which are not CR hypersurfaces. The second distinction 
has to do with the different goals of the papers. To explain this point we mention that, as it is 
well-known, see e.g. [S], the Heisenberg group HP with its flat CR structure, via its identification 
with the boundary of the Siegel upper half-space, is the basic prototype of a CR hypersurface. 
However, even in this specialized context the results in [CM| do not contain ours since we are 
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primarily concerned with global geometric estimates connecting the fully nonlinear operators 
introduced in [DGNT] to the horizontal mean curvature of a relatively compact sub-domain of 
the group itself. On the other hand, in [CM] in the non-compact case the authors work exclusively 
with C^°(M 2n+1 ) functions and the geometry of the boundary plays no role for them. It appears 
that the ultimate goal in [CM] is achieving the sharp constant in their commutator estimates 
since this allows them to generalize to the CR setting the above cited Cordes type results in 
[DM] . 

In closing we briefly describe the organization of the paper. Section [2] is devoted to recalling 
some basic facts about Carnot groups and the notion of horizontal (or sub-Riemannnian) mean 
curvature of a hypersurface in such a group. In section [3] we prove the Bochner identity in 
Proposition 13.31 In section d] we prove our main results: Theorems 11.11 11.61 and 11.81 Finally, in 
Proposition 14.61 we show that in any Carnot group the gauge pseudo-balls satisfy the hypothesis 
of Theorem 11.81 

Acknowledgment: The results in this paper were presented in the special session Subelliptic 
PDE's and Sub-Riemannian Spaces at the AMS Fall Southeastern Section Meeting, University 
of Arkansas, November 3-4, 2006. The author thanks the organizers L. Capogna, S. Pauls and 
J. Tyson for their gracious invitation. 



2. Preliminaries 

Consider a Carnot group G of step r. This is a simply connected Lie group whose Lie algebra 
is graded and r-nilpotent. This means that there exists vector sub-spaces V\, ...,V r C such 
that q = Vi ... V r , with [Vi, Vj] = V i+ i, i = 1, r - 1, [Vi, V r \ = {0}. A natural family of 
non- isotropic dilations on q associated with this grading is given by Aa(£) = A£i + ... + A r £ r , if 
£ = £i + ... + £r € 0. Using the global diffeomorphism exp : — > G, one then lifts these dilations 
to the one-parameter family of group automorphisms 

(2.1) 5 x (g) = expoA A oexp" 1 ^) , A>0. 

The homogeneous dimension associated with the dilations {<5a}a>o is given by 

r 

Q = j dim Vj . 

3=1 

Such number often replaces the topological dimension N = Yuj=i < ^ Lm Vj m ^ ne analysis of G, 
see for instance Corollary 14.41 below. Its relevance is expressed by the fact that, if dg denotes the 
bi-invariant Haar measure on G obtained by pushing forward through the exponential mapping 
the Lebesgue measure on 0, then d(5\(g)) = \®dg. Here, bi-invariant means with respect to the 
operators of left- and right-translation L g (g') = gg' , R g (g') = g'g, on G. 

The gauge pseudo-distance p(g,g') is defined as follows. Let | • | denote the Euclidean distance 
to the origin on 0. For £ = £i + • • • + £ r S 0, £j € Vi, one lets 

/ r \2r! 

(2-2) \£\ g = [J2m 2r]/i J , \g\G = I exp" 1 g\ g , g € G. 

The pseudo-distance on G associated to [ • |g is given by 

(2-3) p{g,g') = {g' 1 g'\ G . 

With a slight abuse of notation when we write p(g) we indicate p(g, e), where e is the group 
identity. Since the function g — > p{g) is homogeneous of degree one with respect to the non- 
isotropic dilations (12. 1|) . we have for the gauge pseudo-ball, 



(2.4) B(g,R) = {g' € G \ p(g' , g) < R}, 
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that \B(g,R)\ = \B(0,1)\E9 . Let rrij = dim Vj, j = l,...,r, and for each j denote by {e J)S }, 
s = 1, ...,m,-, an orthonormal basis of Vj. The vectors {e, s } constitute an orthonormal basis 
of g. Because of the special role played by the first two layers V±, V2 in the grading of q, it is 
convenient to have a simpler notation for the elements of their basis. We thus set henceforth 
m = dim V\, k = dim V2, and will indicate with {ei,...,e m }, {ei,...,efe} the corresponding 
basis of Vi,V2- Denoting with (L g )* the differential of left-translations, we define a family of 
left-invariant vector fields on G by letting 



(2.5) 



x i{9) = ( L g)*((k) > i = l,-.,m, T s {g) = (L g )*(e a ) , s = 1, 
-Xj,s(s) = (L g )*(e jiS ) , j = 3, ...,r , s = l,...,m i . 



Hereafter, we assume that G is endowed with a left-invariant Riemannian metric < •, • > 
with respect to which the vector fields X%, ...,X m ,Ti, ...,Tfc, Xj jS , j = 3, ...r, s = l,...,rrij, are 
orthonormal. In view of the grading assumption on q, it is clear that the vector fields X\, X m 
generate the Lie algebra of all left-invariant vector fields on G. They generate a sub-bundle HG 
of the tangent bundle TG which is usually called the horizontal bundle. 

We next recall some basic concepts from the sub-Riemannian geometry of an hypersurface 
in a Carnot group G. For a detailed account we refer the reader to [DGN2] . We consider 
the Riemannian manifold M = G with the left-invariant metric tensor with respect to which 
Xi, ...,X m , ...,X rmr is an orthonormal basis, the corresponding Levi-Civita connection V on G, 
and the horizontal Levi-Civita connection V . Let C G be a bounded C k domain, with k > 2. 
We denote by v the Riemannian outer normal to dQ, and define the so-called angle function on 
dQ as follows 



(2.6) W = \N 



H 1 



3=1 



The characteristic set of Q, hereafter denoted by S, is the compact subset of dil where the 
continuous function W vanishes 

(2.7) E = {g G 8Q I W(g) = 0} . 

The next definition plays a basic role in sub-Riemannian geometry. 
Definition 2.1. We define the outer horizontal normal on d£l as follows 

m 

(2.8) N H = J2<^ X j> X J > 

i=i 

so that W = \N |. The horizontal Gauss map v H on di~l is defined by 

N H 

(2.9) u H = tt , on <9f} \ £ . 

IJV I 

We note that N H is the projection of the Riemannian Gauss map on dfl onto the horizontal 
subbundle HG C TG. Such projection vanishes only at characteristic points, and this is why 
the horizontal Gauss map is not defined on S. The following definition is taken from [DGN2], 
but the reader should also see [HP] for a related notion in the more general setting of vertically 
rigid spaces. 



Definition 2.2. The horizontal or H-me&n curvature of dO, at a point go € d£l \ S is defined 
as 

m— 1 



8 NICOLA GAROFALO 

def 

where {e\, e m _i} denotes an orthonormal basis of the horizontal tangent bundle T#<9fi = 
TdQ (~1 HG on dQ. If instead go G S, then we define H(go) = lim H(g), provided that the limit 

9-^90 

exists and is finite. 

We next consider the following nonlinear operator 

m 

(2.10) A# i00 U = ^ U ,ij X i U X j U i 

i,3=l 

which by analogy with its by now classical Euclidean ancestor we call the horizontal oo-Laplacian. 
This operator has been recently studied by various people, see e.g. [Bl], [BiCj . [Wa3| . [GT| . The 
reason for introducing the operator A# j00 is in the following proposition which is often useful in 
computing the H-me&n curvature. To state it we recall the notion of a defining function for Q. 
We consider a C 2 bounded open set Q C G and we assume for convenience that there exists a 
globally defined cj) € C 2 (G) (a defining function) such that 

(2.11) n = {g G G | <j>(g) < 0} , 

and for which | V0| > a > in an open neighborhood O of <9f2, where V0 denotes the Riemannian 
gradient of cj). The Riemannian outer unit normal to d£l is presently given by v = V^>/|V0|. 
We observe that 

(2 12) |JV*| = 

and that on <9f2 \ S one has 

(2 13) - ^ 

The next result is Proposition 9.12 in |DGN2j . 

Proposition 2.3. At every point of dVt \ E one has in terms of a local defining function cj) of S 

|V^| 3 H = \V H cb\ 2 A H cj) - A Hy00 cj) . 

We will need the following lemma. 

Lemma 2.4. Let u £ C 2 (G) be H^-convex, then for every s € M. such that the level set 

0, s = {g G G | u(g) < s} 

is a C 2 domain, the H-mean curvature of £ s = dQ, s (wherever it is defined) is nonnegative. 

Proof. Recall that the hypothesis that u be H2-convex means that A#it > 0, and that moreover 

(2.14) (A H u) 2 - ||V^n|| 2 > . 

According to Proposition 12.31 it suffices to show that on £ s one has \X7 h u\ 2 Ahu — A^u > 0. 
On the other hand, Schwarz inequality gives 

m 

A# i00 u = ^2 u,ijXiuXjU < \\V 2 H u\\ \V H u\ 2 < A H u \V H u\ 2 , 
i,j=l 

where in the last inequality we have used (|2.14j) . 



□ 



Given an open set C G denote by 



= {cp Y,"' x > G c^(n,HG) | Halloo = su V (J2<p 2 )^ 2 < i} . 

3=1 ^ 3=1 
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The //-perimeter of a measurable set E C G with respect to f2 was defined in |CDG| as 

Ph(E; Q) = sup / divH(f> dg . 
<t>&T{n) J End 

If E is a bounded open set of class C 1 , then the divergence theorem gives 

P H (E;Q) = sup / <u,Xj > (f)j da = sup / < N H ,4>> da = / liV^dcr , 

0G^(n) JdEnn ' ' ^e^(n) JdEnn JdEnn 

where (icr is the Riemannian surface measure on dE. It is clear form this formula that the 
measure on dE, defined by 

o H (dEnn) d = f p H (E-,n) 

on the open sets of dE, is absolutely continuous with respect to a, and its density is represented 
by the angle function W of dE. We formalize this observation in the following definition. 

Definition 2.5. Given a bounded domain E C G of class C , with angle function W as in 
(|2.7p . we will denote by 

(2.15) da H = \N H \ da = W da , 

the H -perimeter measure supported on dE. 

3. A Bochner type identity 

In this section we establish a sub-Riemannian version of the classical Bochner identity (11. ip 
for the sub-Laplacian of the square of the length of the horizontal gradient of a function on a 
Carnot group G, see Proposition 13.31 A deeper CR version of such formula first appeared in 
the beautiful paper by A. Greenleaf [Gre] . We begin by finding the formula which expresses 
the connection between the Hilbert-Schmidt norm of the symmetrized, and that of the un- 
symmetrized horizontal Hessian. 

Lemma 3.1. Let u G T 2 (G), then one has 

m ^ m 

Y,(X t X 3 u) 2 = \\V 2 H u\\ 2 + - ^(pQ,A» 2 . 

Proof. Notice that the un-symmetrized and the symmetrized second derivatives are connected 
by the formula 

(3.1) XiXju = u ti j + - [Xi,Xj]u . 

We obtain from (13.11) 



m 1 m m 

^(A,A» 2 = \\V 2 H u\\ 2 + - ]T(pQ,X» 2 + X .Y,..Y ; „ . 

To reach the conclusion, it is now enough to observe that, thanks to the skew-symmetry of 
the matrix {[Aj,A"j]}, we have 

m 

^2 U M l X i> X j] U = ^2 U ,ij \ X ii X j\ u + ^2 u ,ij i X ii X j] u = • 
i,j=l i<j i>j 

□ 

Lemma 3.2. For u G T 2 (G) one has 



m ^ m 

Y, XiXjulX^Xjju = - ^(pQ,A» 2 . 



2 

1,3=1 i,j=l 
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Proof. To check this formula we proceed as follows 

m 

(3.2) Yl XiXju[Xi,Xj]u = ^XiXju^X^u + ^ X t X jU [X t , Xj 

i,j=l i<j i>j 

= ^\v ; .\> .y,..y ; > - J2 x i x i u l x " x j} u 

i<j i<j 
1 m 

= ^([x t ,x» 2 = - ^f.Y,..v,>r. 

i<j «,j=l 



□ 



Proposition 3.3. Let G be a Carnot group, u E r 3 (G), then the following sub-Riemannian 
Bochner formula holds 

\a h {\V h u\ 2 ) =<V\V%)> +||V^n|| 2 + i f;([X,,X» 2 

m m 

+ 2 X 3 U [Xi,X 3 \X lU + X i u [Xi,[Xi,Xj]]u ■ 

i,j=l i,j=l 

When G is of step 2, then for every i,j = 1, ...,m, one has pQ, = in the last term in 

the right-hand side of the above identity. In particular, when G = M n , then we have 

(3.3) ~ A^dV^ul 2 ) = < V H u,V H (A H u) > + \\V 2 H u\\ 2 + | n (Tu) 2 

rn 

+ 2 ^ XjulX^XjjXiU . 

Proof. We observe that for any function F we have 

(3.4) A H (F 2 ) = 2 F A H F + 2 \V H F\ 2 . 
Applying (|3.4p to F = Xju we obtain 



m 

2 



(3.5) iA^(|V^| 2 ) = ~ f>„((A» 2 ) = J2 X ^ A H(X jU ) + J2^ X 

j=l j=l i,j=l 

We next compute Ah(Xju). One has 

m m 

(3.6) A H {X jU ) = Y x iX x j u = Y X ^ X i XiU + [ X *> X » 

i=l i=l 

= J2( x i x i + + 

i=l i=l 

m m 

= ^-(Atfu) + A^J^u + 2 Y,{X> X j}X u - 

i=i i=i 

On the other hand, Lemma 13. II gives 

(3.7) E( X ^) 2 = H V ^H 2 + 4 E([ X - X » 2 - 
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Substituting <K7\\ in ([33]) we find 

iA ff (|V^| 2 ) = <V H u,V H (A H )> + \\V 2 H u\\ 2 + - £ ([X u X» 2 



4 



i,j=l i,j=l 



which gives the desired conclusion. 



□ 



4. Geometric second derivative estimates 



In this section using the horizontal Bochner identity in Proposition 13.31 we prove the various 
results stated in the introduction. 

Proof of Theorem We begin by observing that, if we denote by v the outer unit Rie- 
mannian normal on <9$7, then the assumptions u < in $7 and u = on <9$7 imply 

(4.1) Vu = |Vu| v , on dtl . 

Next, we rewrite the identity in Proposition 13.31 as follows 



^a^iv^i 2 ) =<v h u,v h (a h )> +iiviHi 2 + \ jrax^Xj] 



+ 2 ^ .V,// .Y, A',..Y ; >/ + 2 ^ Xj-u [[Xi.X,-],^ 

i,j=l i,j=l 
m 

+ Y X J U [Xi^X^XjUu . 

This gives 

1 1 m 

(4.2) - A„(|V^| 2 ) = < V H u,V H (A H ) > + \\Vluf + - ^(PQ,X» 2 

i,i=l 

m m 
i,j=l i,j=l 

We now integrate the identity (|4.2p on f2 

(4.3) \ f A H (\V H u\ 2 )dg = [ <V H u,V H (A H u)>dg 
1 Jn Jn 

+ f iiv^h 2 ^ + t £ / a^^iW) 2 ^ 

m „ m „ 

ij=l ^ i,i=l ^ 

Using (|4.ip we have from the divergence theorem 

/„ „n 1 f \ n „H ,2a , 1 /" < V^(|V H u| 2 ),V H n > , 
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Also, again from (|4.ip . we find 

(4.5) f <V H u,V H (A H u)>dg = [ l V N 2 ^" da _ [ (A H u) 2 dg . 
Jn Jan l Vn l ./n 

Finally, we have 

(4.6) 2 f; / ^lill^iMs = 2 E / rfa 

m . m „ 

- 2 V / X^uds = -2 V / [l^^l^dg , 

where to eliminate the boundary integral we have used the skew-symmetry of the matrix 
{[^»,^j]tt}ij=i,..., m - Substituting into P~3j) we conclude 

/ (A H n) 2 - IIV^H 2 + - Yl / ([*i,*;]«) 2 <te + E / ^M^^l^Ms 
{\V H u\ 2 A H u- A Hy00 u} 



da = H \V n u\ z da H 



.)-- 

H„.\2, 



an jgn 

where in the last equality we have used Proposition 12.31 and Definition 12.51 This gives the desired 
conclusion. 

□ 

Corollary 4.1. Let G be a Carnot group of step r = 2, and consider a C 2 bounded open set 
ficG. Let u G T 2 (f2) with u < in Q and u = on dfl. One has 



(4.7) 



/ ||V^n|| 2 dg = [ (A H u) 2 dg + j f] f (PQ,A» 2 dg 
Jn Jn 4 ~~z, Jn 



TL \X?hu\ 2 dan ■ 



i an 

-i2/ 



If instead u E Tq{VL), then one obtains 

(4.8) / ||V^n|| 2 dg = f (A H u) 2 dg + \ V / ([X t ,X,] u ) 2 dg . 

Jn Jn 4 • Jn 

We can now present the 

Proof of Theorem \1.6\ We notice that, since u is i/2-convex, then A^u > 0, and (Ahu) 2 — 
HV^ull 2 > in Q. In particular, since by assumption u = on cT2, from Bony's weak maximum 
principle [BoJ we infer that u < in fi, and therefore we can apply Theorem 11.11 The desired 
conclusion now follows from (II. 4h in Theorem 1 1.11 

□ 



We next want to control the commutator term in the right-hand side of (|4.7p in Corollary 14.11 
To reach this goal we will make use of a sub-Riemannian Rellich identity discovered in [GV] . In 
the following results, O will indicate a piecewise C 1 bounded open subset of a Carnot group G 
with outer unit normal v and surface measure a. 
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Theorem 4.2. For u € T 2 (J7) one has 

2 (u <V H u,N H > da + / div G ( \V H u\ 2 dg 
Jan Jn 

- 2 V / [Xi, C]u dff - 2 / QuA H udg 

i=1 Jn 

= / |V^u| 2 < C,^ > d<7, 
Jan 

where Q is a C 1 vector field on G. 

Corollary 4.3. Xei u € r 2 (S7) and assume, in addition, that u = on <9S7. One /ias 
\V H u\ 2 <(,v> da + / divcC I V H u\ 2 dg 



an Jn 



- 2 V / X iU [Xi, (}u dg - 2 (u A H u dg = . 
i=l Jn Jn 

In what follows we indicate with Z the infinitesimal generator of the non-isotropic dilations 
2.ip . We note that in the exponential coordinates it is given by 



m k r TUj 

(4.9) Z = J2 Xi(9) Xi + 2 ^ T s + Yj j J2 X ^) X hS . 

i=l s=l j=3 s=l 

When the step of the group is r = 2 the third sum in the right-hand side of (|4.9p does not 
appear. 

(4.10) [Xi,Z] = Xi , i = l,...,m , dive Z = Q . 

For a proof of the first identity in (|4.10p see Lemma 2.1 in [DG| . The second identity follows 
by using the expression (|4,9p of Z in the exponential coordinates. Choosing n = Z in Corollary 
14.31 an d using (|4.10p we easily obtain. 

Corollary 4.4. Let u G T 2 (J7) and assume, in addition, that u = on <9fL One has 

/ | V^u| 2 < Z, v > da + (Q - 2) / |V H u| 2 dg = 2 Zu A H u dg . 
Jan Jn Jn 

Using Corollary 14.41 we can now prove the following useful estimate. 

Lemma 4.5. Suppose that & be a Carnot group of step r = 2. Under the hypothesis of Corollary 
\4-4\ on the function u there exists a constant C = C(G, 0) > such that for any e > one has 

\V H u\ 2 < Z,u > da + / \V H u\ 2 dg 

on 2 J n 

< a |( 1 + 7) X (A ^ n)2 dg + 6 E I^ [Xi,Xj]u)2 dg J • 

Proof. Since G has step r = 2, from the bracket generating assumption for every s = l,...,k 
there exist af j G R, i,j = 1, ...,m, such that 

m 

t s = ^2 a iji x i,Xj] . 
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Therefore, it is possible to find (3 S > such that 



1/2 



\T s u\ < (3 S ^([JQ,X» S 
y,i=i 

From this estimate, from (14.9)) and from the boundedness of we conclude that there exists 
C = C(G, O) > such that one has 

1/2' 



\Zu Ahu\ < C < 



u 



\Ajju\ , in Q 



Inserting this estimate in the identity of Corollary 14.41 for every 5, e > we find 

/ \V H u\ 2 < Z,v > da + (Q-2) / \V H u\ 2 dg <2 \Zu A H u\ dg 
Jan Jn Jn 

< CS I \V H u\ 2 dg + - [ {A H uf dg 
Jn o Jn 

+ Ce V / {[X^X.jluf dg + - [ {A H uf dg . 

Choosing now 5 > such that C<5 = we obtain the desired conclusion (with a possibly 
different constant C = C(G,Q) > 0). 



□ 



We can now provide the 
Proof of Theorem \1.8[ We start with the inequality (|1.18p in Theorem 11.61 which gives 

(4.11) - A V f {[X u Xj]u) 2 dg < [ H\V H u\ 2 da H < M f \V H u\ 2 da H , 

4 jo Jan Jan 

where we have used the hypothesis (|1.19p . According to Lemma [4. 51 if Vt satisfies the hypothesis 
(jl.20p we obtain for any e > 

V H,2 Wda + (ftl3 f IT7H..I2 



a 


i 




Ian 


< 


1 




Jan 


< 


c{ 



\V H u\ 2 < Z,u > da + 



V H u\ z dg 
(Q-2 



V H u\ 2 dg 



< cUl + ^j j^nu) 2 dg + e j>2 jjXX^X^u) 2 dg J . 



Keeping (|2.15p in mind, we have proved that for any e > 



\V H u\ 2 da H < C(G,a) I (l + j^Hu) 2 dg + ef^ Jji^X^u) 2 dg 



Combining this estimate with (|4.1ip we obtain 
(4.12) 



T [ {[X^X^u) 2 dg < C(G,M,a) + [ {A H u) 2 dg + e V / ([X,, X» 2 dg 

lJ=1 Jn IV ej Jn i j=1 Jn 
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Choosing e > in (|4.12|) such that eC(G, M,a) < 1 we finally reach the desired conclusion. 

□ 

We close with a proposition which provides a significant class of domains which satisfy the 
two geometric hypothesis in Theorem 11.81 

Proposition 4.6. In a Carnot group G of arbitrary step consider a gauge pseudo-ball Br = 
{g G G | p(g) < R}, where p is the Folland-Stein gauge (|2.2p , ()2.3p . There exists C = C(G) > 0, 
a = a(G) > such that 

(4.13) sup \H\ < - , 

dB R R 

and 

(4.14) inf < Z,v > > a RW . 

Proof. The outer unit normal to Br at a point of its boundary is given by v = ■ Since the 

function p is homogeneous of degree one with respect to the non-isotropic group dilations, from 

the Euler type formula for Carnot groups we obtain on 8Br 

^ „ ^ ^ „ Vp Zp p R 

< Z, v > = < Z, —— > 



|Vp| |vh \v P \ |v P | 

On the other hand, since p € C°°(G \ {e}), and since |V^p| is homogeneous of degree zero, 
we have for every g ^ e 

sup \X7 H p(g')\ 
Wig) = |V Pi9)l < ^ ~ C(G) 



\Vp(9)\ ~ |Vp( 5 )| \v P (g)\ • 

We thus obtain on 8Br 

<Z,u>> C{GY l RW = aRW . 

This proves (|4,14p . To prove the qualitative estimate (|4. 13|) we again employ homogeneity 
considerations. According to Proposition 12.31 we have on 8Br 

\v H P \ 3 n = \v H P \ 2 a hP - Ah^p . 

Now, AhP and Ah ooP both have homogeneity —1, and hence so does 7i. We thus find on 
dB R 

\H{g)\ < su P W)l = ' 

P\9) p(g')=l R 

which establishes f)4. 13|) . 

□ 
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